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Abstract 


A stereo camera tracking system has been developed to provide a near real-time mea- 
sure of the position and attitude of the Spacecraft COntrol Laboratory Experiment 
(SCOLE). The SCOLE is a mockup of a shuttle-like vehicle with an attached flexible 
mast and (simulated) antenna, and has been designed to provide a laboratory environ- 
ment for the verification and testing of control laws for large flexible spacecraft. Actuators 
and sensors located on the shuttle and antenna sense the states of the craft and allov the 
position and attitude to be controlled. The stereo camera tracking system which has been 
developed consists of two position-sensitive detector cameras which sense the locations of 
small infrared light emitting diodes (LED’s) attached to the surface of the shuttle. Infor- 
mation on shuttle position and attitude is provided in six degrees of freedom. The c esign 
of this optical system, calibration procedures, and tracking algorithm are described. The 
performance of the system is evaluated for yaw only. 

Introduction 

The Spacecraft COntrol Laboratory Experiment (SCOLE) has been designed and built 
to provide a test environment for the evaluation of control techniques for large flexible 
spacecraft (ref. 1). Specifically, the SCOLE has been developed to study slewing maneu- 
vers and pointing operations. The principal structure consists of a lightweight (simulated) 
antenna attached to a shuttle-like vehicle by a long flexible mast (fig. 1). An overhead 
steel cable, attached to a three-axis gimbal at the shuttle base, supports the weight of the 
structure and allows the vehicle to move freely in pitch, roll, and yaw. In ordei to c mtrol 
the attitude of the shuttle in three degrees of freedom, as required to demonsti ate slew- 
ing and pointing, sensors are required which can measure the pitch, roll, and yaw attitude 
of the vehicle. Previously, pitch and roll were derived from accelerometers located on the 
shuttle platform. An optical sensing system located external to the main structure has 


recently been developed to measure the pitch, roll, and yaw angles of the SCOLE plat- 
form, as well as th i x, y, and z positions of the center-of-rotation of the platform. 

In the evolution of the SCOLE, a variety of sensing techniques have l>een considered 
to measure the platform attitude, specifically yaw, which could not be determined from 
available sensors. Examples of some of these sensing techniques include a tone modulated 
ultrasonic sensor, with the receiver located externally, and the transmitter located inter- 
nally (on the shuttle), a star tracker, a Kalman filter estimator to derive attitude infor- 
mation from accelerometer and rate sensor data, and a stereo optical tracking system. 

Of these techniques, the stereo optical sensor system represents the bes'. compromise 
between accuracy, complexity, and speed. This paper describes the sensor system, 
calibration procedures, tracking algorithm, and performance of this opt cal system. 

Electro-Optical Sensing System 

In the SCOLE electro-optical attitude measurement system, two position-sensitive 
detector (PSD) cameras are used to sense the locations of six small light emitting diodes 
(LED’s) affixed to the surface of the shuttle (fig. 2). The cameras are interfaced to a 
386 PC, which processes the information and computes the rigid body position and 
attitude of the shuttle in six degrees of freedom. The position and attit ide information 
is supplied to the SCOLE computer, an MC68020-based microcomputer system. 

The basic sensor used in the optical tracking system is a United Detector Technologies 
(UDT) planar photodiode. This 1 cm x 1 cm silicon photodiode (a lateral effect photodi- 
ode) has four electrodes, one on each edge (ref. 2). When a photon strikes the surface of 
the diode, a current is generated in each electrode which is proportional to the distance 
between the point at which the photon struck and the corresponding edge. The location 
of the centroid of light falling on the detector is determined by taking the difference of the 
edge signals and normalizing 

x = (.XI - x 2 ) / (•''! + * 2 ) (!) 
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v = (z/i - m) l {yi + //2 ) , 


(2) 


where arj, .T 2 , i/i, and yj are voltage outputs corresponding to the left, right, top, and 
bottom electrodes, respectively. To eliminate the contribution from background (room) 
light, an infrared filter is used which passes wavelengths longer than 880 nm. 

Circuit diagrams of the camera electronics and computer interface are shown in fig- 
ure 3. The output of each electrode is converted to a voltage, filtered, amplified, and dig- 
itized. The digitized signals from the four electrodes are sent over a par allel interface to a 
386 PC. The (centroid) location of the light is then calculated using equations 1 and 2. 

A 25 mm f .95 video camera lens is used to image the small infrared LED targets 
located on the shuttle onto the photodiode detector. The LED’s are multiplexed for target 
identification. A microprocessor located in the camera interface controls the sequencing of 
the LED’s and data transfer to the PC. 

Position and Attitude Determination 

The position and attitude of the SCOLE platform is defined by six parameters; t he 
x, y, z location of the center-of-mass of the shuttle in the fixed (laboratory) reference 
frame, denoted jt OT , ycm , and Zcm, and the Euler angles, V’, 0, and <j> ( ig. 4). These 
six parameters are determined by solving a set of nonlinear equations which relate the 
measured x-y camera coordinates of the six target LED’s to the positioi and attitude of 
the (rigid body) platform. This set of nonlinear equations is derived by substituting the 
three equations 

xtj = Xcm + .7fy(cos(0) cos (VO) + Vbj{~ cos (0) sin(V>) + sin(</>) sin(0) cos (</’)) 

+ sin(0) sin(V’) + cos(0) sin(fl) cos(VO) (3a) 

i/fj = y ( 7 i + Hji cos(0) sin(V’)) + IJbj ( cos (</') cos (VO + sin(f» sin((9) sin((/;)) 

+ Zbj(— sin ((f)) cos {i/j) + cos (<•/>) sin(/?) sin(-0)) (3b) 
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Zfj = Zcm + : > bj(- sin(0)) + Ubj( sin(0) cos((9)) + z b j(caa(<t>) cos (Q)) 
into the photogrammetric collinearity equations (ref. 3) 

mil { x !j ~ T a) + >"12 (>//j ~ Vci) + >"13 U/j ~ z ci) 


(3c) 


x ij — x pi "h fi 


pi 


Uij — Vpi "h fi 


["'-31 ( r.fj - X& ) + Ui, 3 2 (i/fj - yd) + m 33 (zfj - z d ) J 

777.21 (x/j - Xd) + m 2 2 ~ :yq) + ?^23 (g/j - gfli) 


(4a) 


(4b) 


[77731 {xfj - Xd) + 77732 (7 Ifj - yd) + 777.33 (zfj - Zd) \ 

Equation 3(a-b) describes the transformation from body-frame coordinates [x^j , y^j , 2^) 
to fixed-frame coordinates (:r z/j) for a point j on a rigid body in terms of the 
location of the center-of-mass and the Euler angles. The collinearity equations describe 
the transformation from fixed-frame coordinates to camera-frame coordinates, where Xi j 
and ijij are the coordinates of point j in camera /; x ^ and tjpi are the principal points of 
camera i; fi is the focal length of lens 7; x d and z d are the coordinates of the projective 
center of camera i, in the fixed frame; and the rn elements are components of the rotation 
matrix and are functions of the camera pointing angles cu*, 4>j, and /tj. By substituting 
equations 3(a- c) into equations 4(a b), the camera coordinates for any point on the rigid 
body are expressed in terms of the rigid-body position and attitude. The remaining terms 
in these equations, which include the camera parameters and body-frame coordinates 
of the point, are constant and determined beforehand by calibration. Photogramnu trie 
resection and triangulation techniques are used to determine the locations and pointing 
angles of the cameras. 

A total of 24 equations describe the x and y projections of the six LED’s in the 
two cameras. These equations are linearized using a Newton’s approximation, and 
a solution for the position and attitude of the SCOLE, defined by the six parameters, 

■ r cm 1 l Jcm 1 Zcm , 7/7, 0, and (f>, is obtained by using an iterative least squares technique. A 
flowchart of the tracking algorithm is shown in figure 5. 

In the tracking technique described above, successive position and attitude estimates 
are not independent of one another. Since each solution is used as the starting point in 


4 



determining the next solution, how quickly the algorithm converges will depend upon the 
difference between the initial guess (the previous estimate) and the true answer. The mag- 
nitude of the error associated with the initial guess and the magnitude of the positional 
change in the SCOLE from one sample time to the next will determine how great this 
difference is. An obvious difficulty with this approach is that, should one or both of the 
sensors be temporarily lost during an experiment, it would be extremely difficult, if aot 
impossible, to relocate tie model without interrupting the run and stopping the motion. 
This could be overcome by incorporating an additional linear tracking method such as the 
one discussed in reference 5. The advantage in using the nonlinear approach discussed in 
this paper is that this algorithm provides a more accurate estimate of shuttle attitude. 

In order to determine whether or not it would be possible to track the model from one 
sampling time to the next, experiments were conducted in a separate optics laboratory. 
There, it was demonstrated that convergence to less than a degree can be achieved in a 
single iteration with a signal-to-noise ratio of approximately 200, where the signal-to-noise 
ratio is defined as 

Maximum sensor signal (volts) 

signal-to-noise = rrr-:^ u — ' — t ; 

RMS voltage of noise 

and for a change in SCOLE attitude (yaw) of 2° between sampling intervals (fig. 8(a)). 
Studies have shown that, provided the frequency response of the sensing system is greater 
than about 10 samples/sec, the change in the (yaw) attitude of the SCOLE would not 
exceed 2° during any sampling interval (ref. 1). 

Inherent in the above derivation is the assumption that the model is constrained to roll 
and pitch movements of less than 90°. An ambiguity arises should the pitch or roll exceed 
90°. Several algorithms have been developed in robotics for tracking th< unconstrained 
motion of a rigid body where this ambiguity has been overcome (ref. 4). However, in the 
present application, it is unnecessary to use more involved tracking techniques, as the 
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maximum pitch and roll angles of the SCOLE platform are constrained by the laboratory 
setup to less than ±20°. 


Camera Calibration 

Careful calibration of the sensor and optics is required to produce the desired accuracy 
in the estimate of the SCOLE attitude. Lateral effect photodiodes such as the UDT (i.e., 
all four electrodes on the same side) will, due in part to the geometry of the electrodes, 
exibit a nonlinear response outside the central region of the detector. For fixed amplifier 
gains and offsets, this distortion is fixed and, thus, by mapping the response of the detec- 
tor, is quantified and a correction established. In addition to the distortion introduced by 
the nonlinear response of the sensor, there is distortion which arises from the optics. This 
optical distortion is also quantified through calibration. 

Detector Response 

To map the response of the detector and establish a correction for sensor distortion, a 
0.028 inch (0.7 mm) diameter, filtered, HeNe laser beam is scanned over the surface of a 
diode and the output from the four electrodes recorded. (A neutral density filter is used to 
limit the light intensity.) A two-axis beam steering system with computer interface is used 
to scan the laser beam over the surface of a diode. The outputs of the sensor and scanner 
are recorded for 900 different x-y positions arranged in a 30 x 30 matrix. Random sensor 
and scanner errors are removed by averaging 60 scans. In figure 6, the measured x and 
y outputs of a sensor are graphed as a function of the x and y scanner coordinates. It is 
clear from figure 6 that the sensor response is not linear over the entire surface. 
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A distortion correction is determined by fitting the sensor data, using least squares, to 
the scanner data (the scanner beam positions are known to better than ±0.0001 in.). A 
transformation of the form 

x' = a\ + a2X + a^y + a^xy + a$x 2 + agy 2 + a^x 2 y + a^xy 2 + ag c 3 + aioy 3 ( 5 a) 

y' = 61 + &2X + hy + ktxy + &5X 2 + Hv 2 + hx 2 y + b%xy 2 + 6gx 3 f 6ioy 3 ( 5 b) 

is used to relate the normalized x,y beam positions derived from senso 1 data to the x',y' 
scanner beam positions (in inches). The transformation coefficients are saved and used to 
correct subsequent x and y sensor data. 

Lens Calibration 

A lens calibration is performed for two reasons, to determine the location of the sensor 
relative to the perspective center of the camera, by determining the locations of the 
principal points, x p , y p , and the location of the projection of the perspective center on the 
sensor, x () , y 0 ; and to determine a correction for optical distortion. The points x p ,y p> x 0 ,y 0 
are determined by using the techniques described by Burner and Snow in reference 6. To 
determine the principal points, a laser is aligned (with lens removed) perpendicular to the 
sensor plane. The location of the image of the laser beam corresponds to the principal 
points, x p , y p . To determine the projection of the prospective center on the sensor, x 0 , y 0 , 
the laser is aligned perpendicular to the plane of the lens and imaged onto the sensor. 

The image location defines x 0 , y 0 . To correct lens distortion, a model developed by Brown 
(ref. 7 ) is used 

Ax = x ^ir 2 + /2 r4 + h r ^ 

+ f 1 + P3r 2 ^ (pi (r 2 + 2x 2 ) + 2p2xy'j (6a) 
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(6b) 


Ay = Vj (jl r 2 + hr 4 + /3 r6 ) 

+ (l + P3 r2 ) (p 2 (r 2 + 2 y 2 ) + 2p\xyj 

where Ax and Ay are the corrections to the sensor coordinates, x = x' —x p and y = y'—y p , 
previously corrected for sensor distortion, and referred to the principal points x p and y p , 
and r 2 = (x 2 + y 2 ) . To quantify the optical distortion, a calibration fixture consisting of a 
plane of diodes arranged in a 6 x 7 matrix is used. A single camera is positioned with the 
lens parallel to the fixture, and the positions of each diode are averaged over 60 frames 
and recorded. The locations of the diodes in the object field are known to better than 
0.05 in. The known x-y locations of the diodes are fit to the corrected sensor x-y values 
to determine the l, and p coefficients for the camera. 

Results and Discussion 

The tracking accuracy of the SCOLE attitude sensing system has b(ien evaluated 
through experiments conducted in a separate optics laboratory. A sensor geometry like 
that actually used in the SCOLE was maintained in the laboratory. A model of the 
SCOLE was attached to a computer controlled precision rotary stage, with a resolution 
of 0.001°, to allow movement in yaw (fig. 7). Figure 8 shows graphs of yaw angle measured 
by the optical system versus yaw angle measured by the rotary stage. In figure 8(a), the 
displacement in yaw was 2° per sampling interval. In figure 8(b), the yaw displacement 
was 0.5° per sampling interval. The slope is not equal to one in either case as the plane of 
the diodes was not perfectly parallel to the rotary stage. The variance of the data about a 
line fit through the data is 0.08° for figure 8(a), and 0.02° for figure 8(b). 

The data presented in the graphs of figures 8(a) and (b) are the result of averaging 
over several scans. At present, the random noise of the sensors is relatively high. Mul- 
tiple scans are averaged in order to achieve a greater accuracy in the position and atti- 
tude estimate. However, averaging over several scans reduces the frequency response of the 
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optical measurement system. A solution to this problem is currently being implemented; 
the existing diodes are being replaced with more powerful diodes and the gain on the 
amplifiers is being reduced, thereby improving the signal-to-noise ratio With this 
upgrade, it is anticipated that the optical attitude sensing system will operate in excess 
of the required 10 samples/sec, and have an accuracy at least as high as that achieved 
with the present system using multiple scans. 
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Figure 1. Picture of the shuttle platform and flexible antenna of the Spacecraft Controls 
Laboratory Experiment (SCOLE). 
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(b) 


Figure 2. (a) Photograph of SCOLE optical attitude measurement system, (b) Closeup 
photograph of the shuttle platform showing LED targets. 
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Figure 5. Flowchar of tracking algorithm. 
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Figure 8. (a) Yaw estimate versus position oi rotary stage: 2.0° increments between 
measurements. 
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Figure 8. (b) Yaw estimate versus position of rotary stage; 0.5° increments between 
measurements. 
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